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USER ESTABLISHES CONNECTION WITH TELEPHONY 
INTERFACE; CONNECTION INFORMATION PASSED TO t-100 
WAITING VOICE RECOGNITION CLIENT 



REC CLIENT SENDS DATA TO VOICE APPLICATIONS 
INDICATING A NEW CONNECTION HAS BEEN ESTABLISHED 
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VOICE APPLICATIONS PASS PROMPT IDENTIFIER FOR 
LOGIN PROMPTS TO VOICE RECOGNITION CLIENT 
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REC CLIENT STREAMS LOGIN PROMPT WAVEFORM FILE 
TO USER TELEPHONE VIA TELEPHONY INTERFACE OVER 
EXISTING TELEPHONE CONNECTION 
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USER RESPONDS WITH USER ID AND PASSCODE; 
RECEIVED BY TELEPHONY INTERFACE AS WF DATA 
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TELEPHONY INTERFACE PASSES INPUT WF DATA TO 
VOICE RECOGNITION CLIENT 



REC CLIENT IDENTIFIES WF DATA AS USER INPUT AND 
PASSES TO REC SERVER TO BE INTERPRETED 
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VOICE RECOGNITION SERVER CONVERTS VOICE 
WAVEFORM DATA INTO PHONEMES, SYLLABLES, WORDS, 
AND PHRASES TO GENERATE DATA REPRESENTATION OF 

USER INPUT 
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CONVERT DATA REPRESENTATION OF USER INPUT INTO 
VALID USER COMMAND, AS NEEDED 
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RETURN VALID USER COMMAND 
TO VOICE RECOGNITION CLIENT 
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USER COMMAND SENT TO VOICE APPLICATIONS 


—110 






r 




® 
® 


VOICE APPLICATIONS QUERY VOICE DB TO 
AUTHENTICATE USER 
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VOICE APPLICATIONS TRANSPARENTLY LOGS USER 
INTO ENTERPRISE DATA SYSTEM 
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VOICE APPLICATIONS IDENTIFY SYSTEM PROMPT AND 
PASSES TO VOICE RECOGNITION CLIENT 
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REC CLIENT STREAMS SYSTEM PROMPT WAVEFORM 

FILE DATA TO USER TELEPHONE VIA TELEPHONY • 
INTERFACE OVER EXISTING TELEPHONE CONNECTION 
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DETERMINE CURRENT NAVIGATION CONTEXT OF USER 
(SYSTEM STATE) AND PROVIDE APPROPRIATE PROMPT 
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USER PROVIDES INPUT COMPRISING A NAVIGATION 
COMMAND IN RESPONSE TO SYSTEM PROMPT 
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USER VOICE WAVEFORM DATA IS RECEIVED BY 
TELEPHONY INTERFACE AND PASSED TO REC CLIENT 
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REC CLIENT IDENTIFIES WF DATA AS USER INPUT AND 
PASSES DATA TO REC SERVER TO BE INTERPRETED 



I 



REC SERVER INTERPRETS USER INPUT AND RETURNS 
VALID USER COMMAND/RESPONSE TO REC CLIENT 
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REC CLIENT PASSES USER COMMAND/RESPONSE TO 
VOICE APPLICATIONS 



VOICE APPLICATION DETERMINES IF USER INPUT IS 
VALID IN CONSIDERATION OF THE CURRENT 
NAVIGATION CONTEXT OF USER 
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PROVIDE SYSTEM PROMPT TO USER INDICATING THE 
USER INPUT WAS INVALID AND/OR REQUEST A NEW 
COMMAND/RESPONSE BE ENTERED 
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MOVE USER TO NEW NAVIGATION CONTEXT IN 
RESPONSE TO USER COMMAND; UPDATE SYSTEM 
STATE; DETERMINE APPROPRIATE SYSTEM PROMPT 
BASED ON NEW SYSTEM STATE 
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PROVIDE DETERMINED SYSTEM PROMPT TO USER 
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USER PROVIDES SPOKEN NATURAL LANGUAGE QUERY 
INPUT CORRESPONDING TO CURRENT NAV. CONTEXT 
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USER INPUT INTERPRETED AND PROVIDED TO VOICE 
APPLICATIONS IN APP. READABLE FORM: PROCESSING 
SIMILAR TO BLOCKS 100-105 IN FIGURES 5A&5B 
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VOICE APPS. DETERMINE WHAT DATA THE USER 
DESIRES TO RETRIEVE, FORMULATE AN APPROPRIATE 
DATA REQUEST AND SUBMITS DATA REQUEST TO 
ENTERPRISE DATA SYSTEM 
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ENT. DATA SYS GENERATES AN APPROPRIATE QUERY 
BASED ON DATA REQUEST AND SUBMITS QUERY TO 
ENT. DATABASE; QUERY PROCESSED BY DB AND 
RESULT SET INCLUDING NULL, ONE, OR MULTIPLE DATA 
SETS (ROWS) IS RETURNED 
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DATA CORRESPONDING TO QUERY RESULT SET ARE 
RETURNED TO VOICE APPLICATIONS 



BUILD PROMPT/DATA STRING WITH DATA EMBEDDED IN 
"SLOTS" DEFINED BY GRAMMAR SYNTAX LANGUAGE 
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(g) PASS PROMPT ID'S AND DATA STRING TO REC CLIENT j^131 



REC CLIENT PARSES STRING AND SUBMITS DATA 
PORTION TO TTS SERVER FOR TTS CONVERSION 
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TTS SERVER CONVERTS DATA FROM TEXT FORMAT TO 
DIGITAL WAVEFORM STREAM (TTS DATA) AND SENDS 
TO VOICE RECOGNITION CLIENT 



'133 



I 



REC CLIENT STREAMS PROMPT WAVEFORMS AND TTS 
DATA TO USER TELEPHONE VIA TELEPHONY INTERFACE 
OVER EXISTING TELEPHONE CONNECTION IN ORDER 
BASED ON GRAMMAR SYNTAX LANGUAGE 
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VUCE APPS. USER ID, SYS STATE, AND PROMPT ID'S/ 
: DATA SLOTS STRING TO VOICE REC CLIENT 
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REC CLIENT SUBMITS LOOKUP QUERY REQUEST 
TO REC SERVER ALONG, USER ID, SYSTEM STATE 
AND WAVEFORM DATA CORRESPONDING 
TO REQUESTED OBJECT 



REC SERVER PROCESSES WAVEFORM DATA TO OBTAIN 
PHONETIC REPRESENTATION OF REQUESTED OBJECT 



REC SERVER GENERATES AN APPROPRIATE QUERY 
BASED ON SYSTEM STATE, USER ID AND PHONETIC 
REPRESENTATION AND SUBMITS QUERY TO VOICE 
DATABASE, RETURNING RESULT SET INCLUDING NULL, 
ONE, OR MULTIPLE DATA SETS (ROWS) ARE RETURNED 



HEADER DATA EXTRACTED FROM QUERY RESULT SET 
AND PROVIDED TO REC CLIENT 



REC CLIENT PARSES HEADER DATA AND SUBMITS DATA 
(IN PORTIONS )TO TTS SERVER FOR TTS CONVERSION 



TTS SERVER CONVERTS DATA FROM TEXT FORMAT TO 
DIGITAL WAVEFORM STREAM (TTS DATA) AND SENDS 
TO VOICE RECOGNITION CLIENT 



REC CLIENT STREAMS PROMPT WAVEFORMS AND TTS 
DATA TO USER TELEPHONE VIA TELEPHONY INTERFACE 
OVER EXISTING TELEPHONE CONNECTION IN ORDER 
BASED ON GRAMMAR SYNTAX LANGUAGE 
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RETRIEVE USER-SPECIFIC DATA FOR CURRENT BUSINESS 
OBJECT THAT ARE NOT CURRENTLY PRE-COMPILED OR , 

RETRIEVE ALL USER-SPECIFIC DATA FOR BUSINESS 
OBJECT THAT ARE TO BE PRECOMPILED FROM CRM DB 
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RETRIEVE ENTERPRISE DATA FOR CURRENT BUSINESS 
OBJECT THAT ARE NOT CURRENTLY PRE-COMPILED OR 
RETRIEVE ALL ENTERPRISE DATA FOR BUSINESS 
OBJECT ARE TO BE PRECOMPILED FROM CRM DB 
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SUBMIT GRAMMARS TO COMPILATION SERVER 
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COMPILE GRAMMARS WITH COMPILATION SERVER j 
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STORE COMPILED GRAMMARS IN VOICE DATABASE - 
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CONVERT RETRIEVED DATA TO LOWERCASE 
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CONVERT TEXT FROM WRITTEN FORM TO SPOKEN FORM, 
BY EXPANDING ACRONYMS USING ACRONYMS.TXT FILE 
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GENERATE HOMOPHONES 
USING DICTIONARY.TXT FILE 
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RECEIVE COMMAND IN APPLICATION-READABLE FORM 
(E.G., TEXT) FROM VOICE RECOGNITION CLIENT 
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DETERMINE CURRENT NAVIGATION CONTEXT OF USER j^193 



PARSE COMMAND LOOKING FOR KEYWORDS AND DATA 
IN SLOTS DEFINED BY COMMAND GRAMMAR SYNTAX 
CORRESPONDING TO NAVIGATION CONTEXT OF USER 
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RETRIEVE ENTERPRISE DATA SYSTEM USERJD; 
PERFORM USERJD MAPPING BETWEEN VOICE SYSTEM ' 
AND ENTERPRISE SYSTEM, IF NECESSARY 
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FORMULATE QUERY/OBJECT RETRIEVAL REQUEST 
BASED ON KEYWORDS, SLOT DATA, NAVIGATION 
CONTEXT OF USER AND 
ENTERPRISE DATA SYSTEM USERJD 



'199 



FIG. 12 



KEYWORD OPT. DATA KEYWORD 



f ) ^ r r 

"LOOKUP MY NEW OPPORTUNITIES" 



FIG. 13A 



KEYWORD OPT. DATA KEYWORD KEYWORD 

f " \ ^ ^ / < ' 1 

"LOOKUP THE NEW OPPORTUNITIES GREATER THAN [X] DOLLARS" 



[XJT. 

FIG. 13B 



KEYWORD OPT. DATA KEYWORD KEYWORD DATA 

— i y ^ / / / 

"LOOKUP THE OPPORTUNITIES FOR [ACCOUNT NAME]" 

FIG. 13C 



4 



ENTERPRISE USERS'^ 204 FIG. 14 



PK 



E USERID 



PASSWORD 
VIS LEVEL 



OPPORTUNITIES 



PK 



FK1 



OPP ID 



EJJSERID 
NAME 

REVENUE 
CLOSE DATE 
DESCRIPTION 
NEW 



,208 



-H — CX 



OPPT_CONT_MAP^21 0 



PK.FK1 
PK.FK2 



OPP ID 
CONT ID 



-SO — 



OPPT_ACCT_MAP 21 4 



PK.FK1 
PK.FK3 



OPP ID 



ACCT ID 



EMPLOYEES 


PK 


EMP ID 




LAST NAME 




FIRST_NAME 




EMAIL 




SITE 




WORK# 




HOME# 




CELL# 




FAX# 




ADDRESS 




SECURE LEVEL 



CONT_ACCT_MAP' ^ 21 6 
K) — \- 



PK.FK1 
PK 



CONT ID 



ACCT ID 



206 -vp 
H+- OS- 



CALENDAR 



PK,FK1 
PK 



E USERID 



APPT ID 



DESCRIPTION 

STARTJIME 

END_TIME 

NOTES 



212-v^ CONTACTS 



-H- 



PK 



CONT ID 



NAME 

TITLE 

SITE 

WORK# 

HOME# 

CELL# 

FAX# 



-^222 



ACCOUNTS 


^218 


PK 


ACCT ID 


-H 




NAME 






SITE 






MAIN# 






FAX# 






ADDRESS 





USER_ACCOUNTS- 


PK,FK2 
PK.FK1 


E USERID 


ACCT ID 









,220 



^228 (TYP) 



2 



-H CX 


EMP_ACCT_MAP~ 




PK.FK1 
PK.FK2 


EMP ID 


ACCT ID 









226 
^224 



VOICE DATABASE 



/ VOICE_USERS 


PK 


V USERID 






PASSCODE 
E USERID 
PASSWORD 



20 



200 



Domains 



Query 
Option 



Data 
Fields 



FIG. 15 



J. 



304 



Opportunities 




306 



Contacts 



,302 




Log-In 












J- 



308 



Accounts 




j- 



310 



Calendar 




300 



316 

Contacts of specific Opp 
Accounts of specific Opp 
Opportunity Name 
Opp Revenue 
Opp Close date 
Opp Description 

Opp of specific Contact 
Accounts of specific Contact 
Contact Name 
Contact Title 
Work phone # 
Cell phone # 

Home phone # 
Fax machine # 

Opp of specific Account 
Contacts of specific Account 
Account Name 

Account Site (Optional) 

Address (St.#, St., City, 

State, Zipcode) 

Main phone # 
Fax machine # 

Activity Description 
Start Time 
End Time 
Notes 




Cell phone # 
Home phone # 
Address 



Enter PIN for 
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User ID. 

"Please say your 4- 1 322 
digit User ID or enter it \ 
using the keypad." 



Enter PIN for First Time user. 
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New Opportunity Alert. 

"Hi, You have got new 
leads." 
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Main Menu for 
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"You're in 
Opportunites." 
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"Look up my new 
opportunities" 



Main Menu. 

"Goto Opportunities." 
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First time in. 

"You're in Opportunities. The easiest way to get started is to 
say "look up my new opportunities." You can also specify the 
account name or revenue amount. For instance, you could say 
"look up the new opportunities for Bancroft Industries" or "look 
up my opportunities greater than [50,000] dollars". What 
opportunities would you like me to look up?" 
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"You're in Contacts. 
Please tell me to can 
or look up someone 
in your contact list. " 



First time in. 

"Contacts. From here, you can look up o r call any of your contacts. 
For example, you could say "look up Mary Chang" or "look up Mary 
Chang at Bancroft Industries" to hear her contact information. You 
could also say "Call Mary Chang", "Call Mary Chang at work", or "Call 
Mary Chang at Bancroft Industries." Remember, you can always say 
"help" or "What are my choices" to hear the complete list of available 
commands. Okay, let's get started. What would you like to do?" 
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